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SPECIFICATION 

Picture Angle Detection Apparatus and Scanning Lines 
Interpolation Apparatus Using the Same 

5 

TECHNICAL FIELD 

The present invention relates to a picture angle 
detection apparatus that detects the angle of a picture 
displayed based on a video signal, a scanning lines 
10 interpolation apparatus having the same and a picture angle 
detection method. 



BACKGROUND ART 

In order to convert inter laced-scanning video signals 

15 into progressive-scanning video signals or convert 
progressive-scanning video signals into enlarged or reduced 
video signals, an interpolation circuit that carries out 
scanning lines interpolation is used. In the interpolation 
circuit, the value of a pixel to be produced by the interpolation 

20 (hereinafter referred to as "interpolation pixel") is 
calculated based on the values of pixels around the 
interpolation pixel. The angle of a picture having a diagonal 
edge or a thin diagonal line for example is detected based on 
the luminance distribution of surrounding pixels and the value 

25 of the interpolation pixel is calculated using pixels in the 



direction with a higher degree of correlation. 

Japanese Patent Laid-Open No. 9-37214 discloses a 
. progressive scanning lines interpolation apparatus that can 
carry out scanning lines interpolation in a picture having a 
5 diagonal edge. 

The progressive scanning lines interpolation apparatus 
selects candidate sets of pixels for calculating the 
differential absolute value between pixel values from sets of 
original pixels located point-symmetrically . around an 
10 interpolation pixel in order to convert an interlaced-scanning 
video signal into a progressive-scanning video signal. The 
differential absolute values between the values of the selected 
sets of pixels are each calculated. Then, based on the edge 
information of these sets of the original pixels, the 
15 differential absolute values are corrected, a set of original 
pixels whose corrected differential absolute value is minimum 
is detected, and the interpolation pixel is produced based on 
the detected set of original pixels. 

In this way, a picture having a diagonal edge can be 
20 subjected to scanning lines interpolation. 

The conventional progressive scanning lines 
interpolation apparatus however cannot determine whether the 
edge of the picture is a straight line shape or a curved shape 
such as an arc. Therefore, a picture having a curved edge such 
25 as an arc shape cannot be formed into a smooth picture by 
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interpolation . 

DISCLOSURE OF THE INVENTION 

An object of the invention is to provide a picture angle 
5 detection apparatus that can accurately detect the angle and 
shape of a picture displayed based on a video signal. 

Another object of the invention is to provide a scanning 
lines interpolation apparatus that can carry out interpolation 
suitable for the angle and shape of a picture displayed based 
10 on a video signal. 

Further object of the invention is to provide a picture 
angle detection method that can accurately detect the angle 
and shape of a picture displayed based on a video signal 

A picture angle detection apparatus for detecting the 
15 angle of a picture related to a pixel to be interpolated in 
each interpolation scanning line between scanning lines based 
on an input video signal according to one aspect of the invention 
comprises a binary pattern generater that binarizes the input 
video signal in a predetermined detection region including a 
20 plurality of scanning lines and the pixel to be interpolated 
to generate a binary pattern, a reference pattern generater 
that generates binary pictures having different directions as 
a plurality of reference patterns, a comparator that compares 
the binary pattern generated by the binary pattern generater 
25 with each of the plurality of reference patterns to detect the 
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angle of the picture related to the pixel to be interpolated 
based on the comparison result, and a shape detector that 
detects the shape of the picture based on the combination of 
the angle of the picture detected by the comparator related 
5 to the pixel to be interpolated and angles of the picture 
detected in upper and lower interpolation scanning lines above 
and below the pixel. 

In the picture angle detection apparatus according to 
the invention, the binary pattern generater binarizes an input 

10 video signal in a predetermined detection region to generate 
a binary pattern. The reference pattern generater generates 
binary pictures having different directions as a plurality of 
reference patterns. The comparator compares the binary 
pattern with each of the plurality of reference patterns to 

15 detect the angle of the picture related to the pixel to be 
interpolated based on the comparison result. The shape 
detector detects the shape of the picture based on the 
combination of the angle of the picture detected by the 
comparator related to the pixel to be interpolated and angles 

20 of the picture detected in the upper and lower interpolation 
scanning lines. 

In this way, two-dimensional patterns are compared, and 
erroneous detection can be less than the case of using the 
differential value between two pixels, so that the angle of 

25 a diagonal edge of a picture can be detected accurately-. Using 



the two-dimensional reference patterns, the angle to be 
detected is not limited to angles formed by straight lines 
connecting pixels in point-symmetry around the interpolation 
pixel, and angles between these angles can be detected. 
5 Consequently, the angles can be detected by smaller steps. 

The approach to compare a binary pattern with a plurality 
of reference patterns for detecting the curved shape of a 
picture at a time would require an enormous number of reference 
patterns including at least three scanning lines . This could 

10 increase the scale of the circuit and could hardly be practical. 
In the picture angle detection apparatus according to the 
invention, local angles of a picture are detected in a small 
area for each pixel to be interpolated between interpolation 
scanning lines, and the shape of the picture is detected based 

15 on the combination of the detected angles above and below. In 
this case, the shape of the picture can be detected by partly 
improving the configuration for detecting the angle of the 
picture by comparing a binary pattern with a plurality of 
reference patterns . 

20 Consequently, the detection of the shape of the picture 

does not delay the process of detecting the angle of the picture, 
and the angle and shape of the picture can be detected accurately 
without increasing the scale of the circuit. 

Provided that the angle of the picture detected by the 

25 comparator related to the pixel to be interpolated is between 



the angle of the picture detected in the upper interpolation 
scanning line and the angle of the picture detected in the lower 
interpolation scanning line, and the absolute value of the 
angle of the picture detected in the upper interpolation 
5 scanning line is larger than the absolute value of the angle 
of the picture detected in the lower interpolation scanning 
line, the shape detector may output a shape detection signal 
indicating that the shape of the picture is convex toward the 
lower right, when the angle of the picture detected related 

10 to the pixel to be interpolated, and the angle of the picture 
detected in the upper interpolation scanning line and the angle 
of the picture detected in the lower interpolation scanning 
line are positive values, while the shape detector may output 
a shape detection signal indicating that the shape of the 

15 picture is convex toward the lower left, when the angle of the 
picture detected related to the pixel to be interpolated, and 
the angle of the picture detected in the upper interpolation 
scanning line and the angle of the picture detected in the lower 
interpolation scanning line are negative values. Meanwhile, 

20 provided that the angle of the picture detected by the 
comparator related to the pixel to be interpolated is between 
the angle of the picture detected in the upper interpolation 
scanning line and the angle of the picture detected in the lower 
interpolation scanning line, and the absolute value of the 

25 angle of the picture detected in the upper interpolation 
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scanning line is smaller than the absolute value of the angle 
of the picture detected in the lower interpolation scanning 
line, the shape detector may output a shape detection signal 
indicating that the shape of the picture is convex toward the 
5 lower left, when the angle of the picture detected by the 
comparator related to the pixel to be interpolated, and the 
angle of the picture detected in the upper interpolation 
scanning line and the angle of the picture detected in the lower 
interpolation scanning line are positive values, while the 

10 shape detector may output a shape detection signal indicating 
that the shape of the picture is convex toward the upper right, 
when the angle of the picture detected related to the pixel 
to be interpolated, and the angle of the picture detected in 
the upper interpolation scanning line and the angle of the 

15 picture detected in the lower interpolation scanning line are 
negative values . 

In this way, the direction in which the picture has a 
convex shape can be detected depending on the combination of 
the angle of the picture detected related to the pixel to be 

20 interpolated and angles detected in the upper and lower 
interpolation scanning lines . 

When the shape detector detects that the shape of the 
picture is an arc, the detector may output a shape detection 
signal indicating the direction of the inside of the arc. 

25 In this way, the direction of the arc in the picture having 
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the arc shape can be determined based on the shape detection 
signal indicating the inside of the arc. 

The binary pattern generater may include a threshold 
value calculation device that calculates a threshold value for 
binarization based on the luminance of a video signal in the 
detection region, and a binarizer that binarizes the input 
video signal using the threshold value calculated by the 
threshold value calculation device to generate the binary 
pattern . 

In this way, the threshold value for binarization is 
calculated based on the luminance of the video signal in the 
detection region, and therefore the binary pattern can be 
generated without an externally set threshold value and 
irrespective of the luminance level of the video signal. 

The picture angle detection apparatus may further 
comprise a determining device that determines whether or not 
the luminance distribution in the horizontal direction of 
scanning lines is in the form of a monotonous increase or 
decrease in the video signals in the detection region, and the 
comparator may not compare the binary pattern with each of the 
plurality of reference patterns when the luminance 
distribution is neither in the form of a monotonous increase 
nor a monotonous decrease. 

When the luminance distribution in the horizontal 
direction of the scanning lines is not in the form of a 



monotonous increase or decrease in the video signal in the 
detection region, the binary pattern is not compared to each 
of the plurality of reference patterns, and the angle of the 
picture is not detected. In this way, erroneous detection 
5 caused by noise can be reduced. 

The picture angle detection apparatus may further 
comprise a contrast detector that detects a contrast in the 
video signal in the detection region, and the comparator may 
not compare the binary pattern with each of the plurality of 

10 reference patterns when the contrast detected by the contrast 
detector is smaller than a predetermined value. 

When the contrast in the video signal is low, the effect 
of interpolation processing with diagonally located pixels is 
small. Therefore, when the contrast in the video signal in 

15 the detection region is smaller than a predetermined value, 
the binary pattern is not compared with each of the plurality 
of reference patterns and the angle of the picture is not 
detected. In this way, the interpolation processing with 
diagonally located pixels that causes noises may be carried 

20 out only when there can be a great effect. 

The plurality of reference patterns each include a first 
pixel row arranged in a scanning line above the pixel to be 
interpolated and a second pixel row arranged in a scanning line 
below the pixel to be interpolated, the first pixel row has 

25 one transition point from a first pixel value to a second pixel 
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value, the second pixel row has one transition point from a 
first pixel value to a second pixel value, and the transition 
direction from the first pixel value to the second pixel value 
in the first pixel row and the transition direction from the 
5 first pixel value to the second pixel value in the second pixel 
row may be the same. 

In this reference pattern, the pixel row in the upper 
scanning line and the pixel row in the lower scanning line both 
have a luminance change and a luminance gradient in the same 

10 direction. The reference pattern corresponds to a picture with 
a diagonal edge. Consequently, when the binary pattern is 
matched with a reference pattern, the angle of the diagonal 
edge can surely be specified. 

A scanning lines interpolation apparatus according to 

15 another aspect of the invention comprises a picture angle 
detection apparatus that detects the angle and shape of a 
picture related to a pixel to be interpolated based on an input 
video signal, and an interpolation circuit that selects pixels 
to be used for interpolation based on the angle and shape 

20 detected by the picture angle detection apparatus, and 
calculates the value of the pixel to be interpolated using the 
selected pixels to generate an interpolation scanning line. 
The picture angle detection apparatus includes a binary pattern 
generater that binarizes the input video signal in a 

25 predetermined detection region including a plurality of 
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scanning lines and a pixel to be interpolated in each scanning 
line to generate a binary pattern, a reference pattern 
generater that generates binary pictures having different 
directions as a plurality of reference patterns, a comparator 
5 that compares the binary pattern generated by the binary 
pattern generater with each of the plurality of reference 
patterns generated by the reference pattern generater to detect 
the angle of the picture related to the pixel to be interpolated 
based on the result of comparison, and a shape detector that 

10 detects the shape of the picture based on the combination of 
the angle of the picture detected by the comparator related 
to the pixel to be interpolated and the angles of the picture 
detected in upper and lower interpolation scanning lines. 

In the scanning lines interpolation apparatus according 

15 to the invention, the angle detection apparatus surely detects 
the angle and shape of the picture related to the pixel to be 
interpolated based on an input video signal, and pixels to be 
used for interpolation are selected based on the angle and shape 
detected by the picture angle detection apparatus. Using the 

20 selected pixels, the interpolation circuit calculates the 
value of the pixel to be interpolated to generate an 
interpolation scanning line. 

In this way, the pixels to be used for interpolation are 
selected depending on the shape of the picture, and therefore 

25 not only straight line shapes but also curved, diagonal edges 
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may smoothly be interpolated. 

Consequently, smooth interpolation suitable for the 
angle and shape of the picture displayed based on the video 
signal can be carried out. 
5 When the shape detector detects that the shape of the 

picture is an- arc, the detector may output a shape detection 
signal indicating the direction of the inside of the arc, and 
the interpolation circuit may select pixels to be used for 
interpolation from the inside of the arc based on the shape 

10 detection signal output from the shape detector and calculate 
the value of the pixel to be interpolated using the selected 
pixels to generate an interpolation scanning line. 

In this way, the pixels to be used for interpolation are 
selected from the inside of the arc based on the shape detection 

15 signal indicating the direction of the inside of the arc, and 
the value of the pixel to be interpolated is calculated using 
the selected pixels. Therefore, smooth interpolation along 
the shape of the arc can be carried out. 

When the shape detector detects that the shape of the 

20 picture is an arc, the detector may output a shape detection 
signal indicating the direction of the inside of the arc. The 
interpolation circuit may select positions shifted in the 
direction of the inside of the arc by 0 . 5 pixel from positions 
in the upper and lower scanning lines in the direction of the 

25 angle of the picture detected for the pixel to be interpolated 
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and calculate the value of the pixel to be interpolated using 
the values of the pixels in the selected positions in order 
to generate an interpolation scanning line. 

In this way, the pixels to be used for interpolation are 
5 selected from specified pixels within the inside of the arc 
based on the shape detection signal indicating the inside of 
the arc. The value of the pixel to be interpolated is then 
calculated using the selected pixels. Therefore, smooth 
interpolation along the shape of the arc can be carried out. 

10 Furthermore, the pixels to be used for interpolation can 

be selected depending on the shape of the arc, and therefore 
not only straight line shapes but also diagonal edges of arc 
shapes may smoothly be interpolated. 

A picture angle detection method for detecting the angle 

15 of a picture related to a pixel to be interpolated in each 
interpolation scanning line between scanning lines based on 
an input video signal according to further aspect of the 
invention comprises the steps of binarizing the input video 
signal in a predetermined detection region including a 

20 plurality of scanning lines and the pixel to be interpolated 
to generate a binary pattern, generating binary pictures having 
different directions as a plurality of reference patterns, 
comparing the generated binary pattern with each of the 
generated plurality of reference patterns to detect the angle 

25 of the picture related to the pixel to be interpolated based 
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on the comparison result, and detecting the shape of the picture 
based on the combination of the detected angle of the picture 
related to the pixel to be interpolated and angles of the picture 
detected in upper and lower interpolation scanning lines above 
5 and below the pixel. 

In the picture angle detection method according to the 
invention, an input video signal in a predetermined detection 
region is binarized to generate a binary pattern. Binary 
pictures having different directions are generated as a 

10 plurality of reference patterns. The binary pattern is 
compared with each of the plurality of reference patterns to 
detect the angle of the picture related to the pixel to be 
interpolated based on the comparison result. The shape of the 
picture is detected based on the combination of the angle of 

15 the detected picture related to the pixel to be interpolated 
and angles of the picture detected in the upper and lower 
interpolation scanning lines . 

In this way, two-dimensional patterns are compared, and 
erroneous detection can be less than the case of using the 

20 differential value between two pixels, so that the angle of 
a diagonal edge of a picture can be detected accurately. Using 
the two-dimensional reference patterns, the angle to be 
detected is not limited to angles formed by straight lines 
connecting pixels in point-symmetry around the interpolation 

25 pixel, and angles between these angles can be detected. 
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Consequently, the angles can be detected by smaller steps. 

Local angles of a picture are detected in a small area 
for each pixel to be interpolated between interpolation 
scanning lines, and the shape of the picture is detected based 
5 on the combination of the detected angles above and below. In 
this case, the shape of the picture can be detected by partly 
improving the configuration for detecting the angle of the 
picture by comparing a binary pattern with a plurality of 
reference patterns. 
10 Consequently, the detection of the shape of the picture 

does not delay the process of detecting the angle of the picture, 
and the angle and shape of the picture can be detected accurately 
without increasing the scale of the circuit. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the configuration of 
a picture angle detection apparatus according to an embodiment 
of the invention; 

Fig. 2 is a schematic diagram showing an example of a 
20 binary pattern output from a binarizer in the apparatus; 

Figs. 3 to 6 are schematic diagrams each showing an 
example of reference patterns generated by the reference 
pattern generater shown in Fig. 1; 

Fig. 7 is a table for use in illustration of processing 
25 by the arc shape detector in Fig. 1; 
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Fig. 8 is a block diagram showing the configuration of 
a scanning lines interpolation apparatus including the picture 
angles detection apparatus shown in Fig. 1; 

Fig. 9 is a block diagram showing the configuration of 
5 an interpolation circuit in the scanning lines interpolation 
apparatus shown in Fig. 8; 

Fig. 10 is a schematic diagram showing an example of the 
angles of a picture detected by the picture angle detection 
apparatus shown in Fig. 1; 
10 Fig. 11 is a schematic diagram showing an example of 

interpolation of pixels using the angle information and arc 
shape information of a picture detected by the picture angle 
detection apparatus shown in Fig. 1; and 

Fig. 12 is a schematic diagram showing an example of 
15 interpolation of pixels using the angle information of a 
picture detected by the picture angle detection apparatus shown 
in Fig. 1. 

BEST MODE FOR CARRYING OUT THE INVENTION 
20 Fig. 1 is a block diagram of the configuration of a picture 

angle detection apparatus according to an embodiment of the 
invention . 

The picture angle detection apparatus 10 shown in Fig. 
1 includes line memories la, lb, and 1c, a binarizer 2, an angle 
25 detector 3, an arc shape detector 4, a detection window video 
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signal processor 5, a reference pattern generater 6, and an 
A/D (analog/digital) converter 7. 

The A/D converter 7 converts an analog video signal VA 
into a digital video signal VD1 for output. The video signal 
5 VD1 output from the A/D converter 7 is input into the line memory 
la and the binarizer 2 and the detection window video signal 
processor 5. The line memory la delays the video signal VD1 
output from the A/D converter 7 by one scanning line for output. 
The video signal VD2 thus output from the line memory la is 

10 provided to the binarizer 2 and the detection window video 
signal processor 5. 

In this example, the video signals VD1 and VD2 have 256 
gray scale luminance levels. More specifically, the minimum 
luminance value for the video signals VD1 and VD2 is "0" and 

15 the maximum value is "255". 

The binarizer 2 binarizes the video signal VD1 output 
from the A/D converter 7 and the video signal VD2 output from 
the line memory la using an average luminance value LU applied 
from the detection window video signal processor 5 that will 

20 be described and outputs a binary pattern BI of "1" and "0". 
The binary pattern BI has a size equal to that of the detection 
window . 

Here, the detection window is for example a rectangular 
region including 7x2 pixels, seven pixels of which are from 
25 the video signal VD1 and the remaining seven pixels are from 
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the video signal VD2, or a rectangular region including 15 x 
2 pixels, 15 pixels of which are from the video signal VD1 and 
the remaining 15 pixels are from the video signal VD2 . Note 
that in the following description, the size of the detection 
5 window is 9 x 2 pixels. In this case, the size of the binary 
pattern BI is also 9 x 2 pixels. The size of the detection window 
is not limited to these, which can be set arbitrarily within 
the scope of the invention. 

The detection window video signal processor 5 sets a 

10 detection window for the input video signal VD1 and the video 
signal VD2 output from the line memory la, calculates the 
average luminance value of the video signals VD1 and VD2 in 
the detection window, and provides the resulting average 
luminance value LU to the binarizer 2 as a threshold value for 

15 binarization . 

Note that according to the embodiment, the average 
luminance value of all the pixels in the detection window is 
used as the threshold for binarization. However, the average 
value between the maximum and minimum values of the pixels in 

20 the detection window or the middle number in the sequence of 
luminance values in the order of magnitude may be used as the 
threshold value. Alternatively, the average luminance value 
of a plurality of pixels whose values are close to the middle 
number in the sequence of luminance values in the order of 

25 magnitude may be used as the threshold value for binarization. 



The detection window video signal processor 5 determines 
whether or not the horizontal luminance distribution of the 
video signals VD1 and VD2 in the detection window is in the 
form of a monotonous increase or decrease. When the 
distribution is not in the form of a monotonous increase or 
decrease, the minimum value "0" or the maximum value "255" may 
be provided to the binarizer 2 as a threshold value. Then, 
the binarizer 2 outputs a binary pattern BI of all "1" or "0" . 
In this case, the differential value between two adjacent 
pixels in the video signals VD1 and VD2 may be calculated 
sequentially, and if the differential values have the same sign, 
it could be determined that the distribution is in the form 
of a monotonous increase or decrease. 

The detection window video signal processor 5 calculates 
the difference between the maximum and minimum luminance values 
of the video signals VD1 and VD2 in the detection window as 
a contrast. Then, when the calculated contrast is lower than 
a prdetermined value, the minimum value "0" or the maximum value 
"255" is provided to the binarizer 2. In this way, the 
binarizer 2 outputs a binary pattern BI of all "1" or "0". 

The reference pattern generater 6 generates a plurality 
of reference patterns RA of "1" and "0" and applies the patterns 
to the angle detector 3. The reference patterns RA each have 
a size equal to that of the detection window. 

The angle detector 3 compares the binary pattern BI 
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provided from the binarizer 2 with each of the plurality of 
reference patterns RA provided from the reference pattern 
generater 6 and outputs the angle of a matched one of the 
reference patterns RA as angle information SI. The angle will 
5 later be described. Now, the comparison operation between the 
binary pattern BI and the reference patterns RA will be referred 
to as "pattern matching" . 

As described above, if the luminance distributions of 
the video signals VD1 and VD2 in the detection window are both 

10 not in the form of a monotonous increase or decrease, a binary 
pattern BI of all "1" or "0" may be output from the binarizer 
2. In this case, the angle information SI is not output from 
the angle detector 3. 

When the contrast in the video signals VD1 and VD2 in 

15 the detection window is lower than the predetermined value, 
a binary pattern BI of all "1" or "0" is output from the binarizer 
2, and therefore the angle information SI is not output from 
the angle detector 3. 

When the contrast in the video signals VD1 and VD2 is 

20 low, the effect of interpolation using diagonally located 
pixels is small. In interpolation using diagonally located 
pixels, noises could be caused unless angles are not accurately 
detected. Therefore, when the effect is low, the angle 
information SI is not output so that the interpolation using 

25 diagonally located pixels is not carried out. 



21 

The line memory lb outputs angle information S2 delayed 
by one scanning line from the angle information SI output from 
the angle detector 3 to the arc shape detector 4 and the line 
memory lc. The line memory lc applies angle information S3 
5 delayed by one scanning line from the angle information S2 
output from the line memory lb to the arc shape detector 4. 

Here, a scanning line including an interpolation pixel 
will be referred to as "interpolation scanning line". The arc 
shape detector 4 outputs picture edge angle information Tl 

10 based on the combination of the angle information S3 of an 
interpolation scanning line one line above the object 
interpolation scanning line, the angle information SI of an 
interpolation scanning line one line below the object 
interpolation scanning line, and the angle information S2 of 

15 the object interpolation scanning line . The arc shape detector 
4 also recognizes the arc shape and outputs arc shape 
information T2 . Note that the angle detection and the arc shape 
recognition will be detailed later. 

Fig. 2 is a schematic diagram showing an example of the 

20 binary pattern BI output from the binarizer 2 shown in Fig. 
1. 

In Fig. 2, IN represents an interpolation pixel and IL 
represents an interpolation scanning line. Also in the figure, 
AL represents a scanning line one line above the interpolation 
25 scanning line IL, while BL represents a scanning line one line 
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below the interpolation scanning line IL. 

In the example in Fig. 2, the low luminance part (dark 
part) is indicated by "0" and the high luminance part (bright 
part) is indicated by "1" . In the binary pattern BI, the angle 
5 of the edge of a picture is 4 5° . Here, the horizontal angle 
is 0 and the angle in the upper right diagonal direction is 
positive . 

Figs. 3, 4, 5, and 6 are schematic diagrams each showing 
an example of reference patterns generated by the reference 
10 pattern generater 6 in Fig. 1. The shadowed pixels are pixels 
in the upper and lower scanning • lines that are used for 
calculating values of interpolation pixels indicated by bold 
squares . 

In Fig. 3, (a), (b) , (c) , (d) , (e) , and (f) are reference 
15 patterns for 45% 34% 27°, 22°, 18% and 16% respectively. 
In the example in Fig. 3, the upper left part is a dark part 
and the lower right part is a bright part. In Fig. 4, (a), 
(b) , (c), (d) , (e), and (f) are reference patterns for 45% 
34°, 27°, 22°, 18% and 16°, respectively. In the example in 
20 Fig. 4, the upper left part is a bright part and the lower right 
part is a dark part. 

In Fig. 5, (a), (b) , (c) , (d) , (e) , and (f) are reference 
patterns for -45% -34% -27°, -22% -18% and -16% 
respectively. In the example in Fig. 5, the upper right part 
25 is a dark part and the lower left part is a bright part. In 



23 

Fig. 6, (a) , (b) , (c) , (d) , (e) , and (f ) are reference patterns 
for -45°, -34% -27°, -22°, -18% and -16°, respectively. In 
the example in Fig. 6, the upper right part is a bright part 
and the lower left part is a dark part. 
5 The reference patterns shown in Figs. 3 to 6 are compared 

with the binary pattern BI output from the binarizer 2 at the 
angle detector 3, and the angle detector 3 outputs the angle 
information SI of the reference pattern matched with the 
pattern BI. 

10 In addition, as shown in Figs. 3 to 6, in the reference 

patterns based on two-dimensional luminance distribution, not 
only angles between straight lines connecting pixels located 
in point-symmetrical positions around the interpolation pixel 
but also angles between these angles may be set. For example, 

15 angles 34° and 22° between 45°, 27°, and 18° can be set. 

The binary pattern BI in Fig. 2 for example can be matched 
with one of the six reference patterns at (a) in Fig. 4. In 
this case, the angle detector 3 in Fig. 1 outputs 45° indicated 
by the reference pattern . at (a) in Fig. 4 as the angle 

20 information SI. Note that the reference patterns RA 
generated by the reference pattern generater 6 in Fig. 1 may 
have an arbitrary size other than those of the examples shown 
in Fig. 6. 

Fig. 7 is a table for use in illustration of processing 
25 by the arc shape detector 4 in Fig. 1. The table in Fig. 7 
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includes detected angles for interpolation pixels, and 
examples of arc shapes recognized based on combinations of 
detected angles in a lower interpolation scanning line and an 
upper interpolation scanning line. 
5 More specifically, the arc shapes are divided into five 

cases of combinations A, B, C, D, and E. 

In Case A in Fig. 7, the edge of the arc (arc edge) has 
a convex shape directed to the "lower right", and the inside 
of the arc is directed to the "left" . In this case, the absolute 

10 value of the detected angle of the interpolation pixel is the 
intermediate value between the absolute values of the detected 
angle in the lower and upper interpolation scanning lines. The 
absolute value of the detected angle in the upper interpolation 
scanning line is larger than the absolute value of the detected 

15 angle in the lower interpolation scanning line and all the 
detected angles are positive values. 

The arc shape detector 4 outputs the detected angle of 
the interpolation pixel as angle information Tl. When an arc 
shape is recognized, the direction of the inside of the arc 

20 shape is output as arc shape information T2 . 

Fig. 7 shows schematic arc shapes and the directions of 
the inside of the arc shapes in the right most column by way 
of illustration. The sets of thin connected arrows are each 
recognized as an arc, and the direction of each of the thin 

25 arrows indicates an angle detected along the arc, and thick 
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arrows indicate the insides of the arcs. 

Similarly to Case A in Fig. 7 , in the combination cases 
B, C, and D, the direction of the convex shape of the arc edge 
and the direction of the inside of the arc shape are shown. 
5 In Case B in Fig. 7 , the direction of the convex shape 

of the arc edge is the "upper right" and the direction of the 
inside is the "left". In this case, the absolute value of the 
detected angles of the interpolation pixel is the intermediate 
value between the absolute values of the detected angles in 

10 the lower and upper interpolation scanning lines. The absolute 
value of the detected angle in the upper interpolation scanning 
line is smaller than the absolute value of the detected angle 
in the lower interpolation scanning line and all the detected 
angles are negative values. 

15 In the combination in Case C in Fig. 7 , the direction 

of the convex shape of the arc edge is the "upper left" and 
the direction of the inside of the arc shape is the "right". 
In this case, the absolute value of the interpolation pixel 
is the intermediate value between the absolute values of the 

20 detected angles in the lower and upper interpolation scanning 
lines. The absolute value of the detected angle in the upper 
interpolation scanning line is smaller than the absolute value 
of the detected angle in the lower interpolation scanning line 
and all the detected angles are positive values. 

25 In the combination in Case D in Fig. 7, the direction 
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of the convex shape of the arc edge is the "lower left" and 
the direction of the inside of the arc shape is the "right". 
In this case, the absolute value of the detected angle of the 
interpolation pixel is the intermediate value between the 
5 absolute values of the detected angle in the lower and upper 
interpolation scanning lines. The absolute value of the 
detected angles in the upper interpolation scanning line is 
smaller than the absolute value of the detected angle in the 
lower interpolation scanning line and all the detected angles 

10 are negative values. 

In Case E in Fig. 7, the combination of detected angles 
cannot be recognized as that of an arc shape . More specifically, 
any combinations not belonging to the combinations in Cases 
A, B, C, and D all belong to Case E in Fig. 7. 

15 Note that the intermediate value is defined as any value 

between two values X and Y, and larger than X and smaller than 
Y when X<Y . 

The reference position for a detected angle in the upper 
interpolation scanning line corresponds to a single point in 

20 the direction determined based on the detected angle of the 
interpolation pixel in the upper interpolation scanning line 
relative to the interpolation pixel. The reference position 
for the detected angle in the lower interpolation scanning line 
corresponds to a single point in the direction determined based 

25 on the detected angle of the interpolation pixel in the upper 
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interpolation scanning line relative to the interpolation 
pixel . 

The reference position for a detected angle in the upper 
interpolation scanning line may be a horizontal region (of a 
5 plurality of pixels) having a predetermined width including 
a point in the direction determined based on the detected angle 
of the interpolation pixel in the upper interpolation scanning 
line relative to the interpolation pixel. The reference 
position for a detected angle in the lower interpolation 

10 scanning line may be a horizontal region (of a plurality of 
pixels) having a predetermined width including a point in the 
direction determined based on the detected angle of the 
interpolation pixel in the lower interpolation scanning line 
relative to the interpolation pixel. 

15 Note that the combinations of the detected angle of the 

interpolation pixel, and the detected angles in the upper and 
lower interpolation scanning lines as shown in Fig. 7 are only 
by way of illustration, and by no means intended as being 
restrictive. Combinations other than those shown may be 

20 employed. 

In the picture angle detection apparatus 10 according 
to the embodiment, the luminance distribution of the video 
signals VD1 and VD2 in the detection widow is converted into 
the binary pattern BI . Then, the binary pattern BI is compared 
25 for. pattern matching with a plurality of preset reference 
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patterns RA, so that the angle of a diagonal edge in a picture 
can be detected with a small scale circuit configuration. 

In this way, the average luminance value in the detection 
window is used as the threshold value for binari zation, and 
5 therefore a binary pattern BI including both "0" and "1" can 
always be produced regardless of the luminance level of the 
picture and without an externally set binary threshold value. 

Since the pattern matching is carried out based on the 
two-dimensional luminance distribution, erroneous detection 

10 can be less than the case of using the differential value between 
two pixels, so that the angle of a diagonal edge of a picture 
can be detected accurately. 

Using the reference patterns RA based on the two- 
dimensional luminance distribution, the angle to be detected 

15 is not limited to an angle formed by straight lines connecting 
pixels in point-symmetry around the interpolation pixel, and 
angles between these angles can be detected. Consequently, 
the angles can be detected at smaller intervals using the line 
memory la with a smaller capacity. 

20 Since an arc shape can be recognized based on the 

combination of the detected angle of the interpolation pixel, 
and the detected angles of the upper and lower interpolation 
scanning lines, reference patterns that require three or more 
scanning lines are not necessary. Consequently, the angle of 

25 a picture can be detected and the arc shape can be recognized 
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without increasing the circuit scale of the picture angle 
detection apparatus 10 or the calculation range by the 
apparatus . 

Fig. 8 is a block diagram showing the configuration of 
5 a scanning lines interpolation apparatus including the picture 
angle detection apparatus shown in Fig. 1. 

In Fig. 8, the scanning lines interpolation apparatus 
100 includes the picture angle detection apparatus 10 and an 
interpolation circuit 20. A video signal VA is input to the 
10 picture angle detection apparatus 10 and the interpolation 
circuit 20. 

The picture angle detection apparatus 10 has the same 
configuration as that of the picture angle detection apparatus 
10 shown in Fig. 1. The picture angle detection apparatus 10 

15 detects the angle of a diagonal edge or an arc shape of a picture 
based on the video signal VA, and outputs angle information 
Tl and arc shape information T2 . The interpolation circuit 
20 selects pixels from the upper and lower scanning lines in 
a diagonal direction relative to the interpolation pixel based 

20 on the angle information Tl and the arc shape information T2, 
calculates the luminance value of the interpolation pixel using 
the luminance values of the selected pixels, and outputs an 
interpolation video signal VOUT . 

In the scanning lines interpolation apparatus 100 shown 

25 in Fig. 8, the angles of a picture whose edge in a diagonal 
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direction includes not only a straight line shape but also an 
arc shape can accurately be detected, and the arc shape can 
be recognized. Therefore, for the picture whose edge in a 
diagonal direction includes not only a straight line shape but 
5 also an arc shape, suitable pixels in the diagonal direction 
can be selected to carry out smooth interpolation. 

Fig. 9 is a block diagram of the configuration of the 
interpolation circuit 20 in the scanning lines interpolation 
apparatus 100 shown in Fig. 8. 

10 The interpolation circuit 20 in Fig. 9 includes an A/D 

(analog/digital) converter 21, a line memory 22, an 
interpolation pixel selection circuit 23, and an average value 
operation circuit 24. 

The A/D converter 2.1 converts an analog video signal VA 

15 into a digital video signal VD1 for output. The video signal 
VD1 output from the A/D converter 21 is input into the line 
memory 22 and the interpolation pixel selection circuit 23. 
The line memory 22 delays the video signal VD1 output from the 
A/D converter 21 by one scanning line for output. The video 

20 signal VD2 thus output from the line memory 22 is provided to 
the interpolation pixel selection circuit 23. 

Using the provided video signals VD1 and VD2, and the 
angle information Tl and the arc shape information T2 in the 
picture angle detection apparatus 10, the interpolation pixel 

25 selection circuit 23 selects an interpolation reference pixel 



PI from the upper scanning line for output and an interpolation 
reference pixel P2 from the lower scanning line for output to 
the average value operation circuit 24. 

The average value operation circuit 24 calculates and 
outputs the luminance value of the interpolation pixel based 
on the interpolation reference pixels PI and P2 . 

The interpolation pixel selection circuit 23 selects 
these interpolation reference pixels so that edges in a picture 
can be smoothed by interpolation. The interpolation pixel 
selection circuit 23 performs selectively the operation for 
the case when the picture has a straight line shaped edge and 
the operation for the case when the picture has an arc shaped 
edge. When the picture has a straight line shaped edge, the 
interpolation pixel selection circuit 23 selects pixels in the 
shadowed part in Figs. 3 to 6 from the upper and lower scanning 
lines as interpolation reference pixels . The center positions 
of the interpolation reference pixels are interpolation 
reference positions. Meanwhile, when the picture has an arc 
shaped edge, the interpolation pixel selection circuit 23 
specifies positions in the direction relative to the 
interpolation pixel indicated by the angle information Tl, and 
selects positions shifted horizontally within the inside of 
the arc shape as the interpolation reference positions based 
on the arc shape information T2 . 

With reference to Fig. 7, for example, when the arc shape 
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in Case A is detected, the direction of the inside of the arc 
is the left as denoted by the thick arrow, and therefore the 
interpolation pixel selection circuit 23 specifies positions 
in the direction indicated by the angle information Tl in the 
upper and lower scanning lines relative to the interpolation 
pixel, and selects the interpolation reference positions from 
positions shifted to the left from the specified positions. 

It has been confirmed through experiments that for a 
picture with an arc shape, the arc shape is most smoothly formed 
by interpolation when the positions 0.5 pixel shifted from the 
interpolation reference positions selected for the picture 
having a straight line shaped edge are selected as the 
interpolation reference positions . 

The average value operation circuit 24 calculates the 
average luminance value of the pixels including the 
interpolation reference positions to determine the luminance 
value of the interpolation pixel. Although not shown, the 
average value operation circuit 24 includes a correlation 
operation circuit and may carry out interpolation operation 
corresponding to the correlation degree, i.e., the difference 
between the pixels including the interpolation reference 
positions. In this way, if the angle or arc shape is detected 
erroneously for some reason, a noise caused by interpolation 
can be reduced. 

Fig. 10 shows an example of angle information of a picture 
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detected by the picture angle detection apparatus 10 shown in 
Fig. 1. An example of a picture having an arc-shaped edge is 
shown in Fig. 10. Fig. 11 shows an example of interpolation 
of pixels using the angle information and arc shape information 
5 of the picture detected by the picture angle detection 
apparatus 10 shown in Fig. 1. In comparison, Fig. 12 shows 
an example of interpolation of pixels using only the angle 
information of the picture detected by the picture angle 
detection apparatus 10 shown in Fig. 1. 

10 In Figs. 10 to 12, IL1, IL2 and IL3 represent 

interpolation scanning lines. Also in the figures, AL, BL, 
CL, and DL represent scanning lines. In Figs. 10 to 12, the 
values on the scanning lines AL, BL, CL, and DL represent the 
luminance values of the pixels. In Fig. 10, the values on the 

15 interpolation scanning lines IL1, IL2, and IL3 are the 
luminance values of interpolation pixels. In Figs. 11 and 12, 
the values on the IL1, IL2, and IL3 represent the luminance 
values of the interpolation pixels. 

Here, IN is an interpolation pixel of interest. In this 

20 case, IL2 represents an object interpolation scanning line, 
BL is a scanning line above the interpolation scanning line, 
CL is a scanning line below the interpolation scanning line, 
IL1 is an upper interpolation scanning line and IL3 is a lower 
interpolation scanning line. In Figs. 11 and 12, the 

25 interpolation reference positions PI, P2, P3 and P4 are denoted 
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by x. In the example in Fig. 10, the angle of the object 
interpolation pixel IN relative to the picture is 27°. 

In the example in Fig. 12, the positions directed at 27° 
to the interpolation pixel IN are selected as interpolation 
5 reference positions P3 and P4 in the upper and lower scanning 
lines BL and CL . The luminance values of the pixels Q3 and 
Q4 including interpolation reference positions P3 and P4 are 
both " 100 " and therefore the luminance value of the 
interpolation pixel IN is "100" after interpolation operation 

10 using the pixels Q3 and Q4 including the interpolation 
reference positions P3 and P4 . The luminance values of the 
other interpolation pixels are calculated in the same manner, 
so that the processing result as shown in Fig. 12 is provided. 

In the example in Fig. 11, Rl and R2 represent reference 

15 pixels for the upper and lower interpolation scanning lines 
IL1 and IL3, respectively. The angle information of the 
reference pixel Rl is 45° and the angle information of the 
reference pixel R2 is 18°. Therefore, the example in Fig. 11 
corresponds to Case A in Fig. 7, and the direction of the inside 

20 of the arc shape is the left. Consequently, the positions pi 
and p2 at 27° relative to the interpolation pixel IN are 
specified in the upper and lower scanning lines BL and CL, and 
the positions 0.5 pixel shifted horizontally to the left from 
these specified positions pi and p2 are selected as the 

25 interpolation reference positions PI and P2 . The luminance 



values of the pixels including the interpolation positions 
PI and P2 are each the average luminance value between the 
luminance values "100" and "0" of two adjacent pixels Qll and 
Q12; Q13 and Q14, in other words, the luminance values are both 
"50". Therefore, the luminance value of the interpolation 
pixel IN is "50" after interpolation operation using the pixels 
including the interpolation reference positions PI and P2 . The 
luminance values of the other interpolation pixels are 
calculated in the same manner, so that the result as shown in 
Fig. 11 is provided. 

Note that in Figs. 11 and 12, the values on the 
interpolation scanning lines IL1, IL2, and IL3 are the 
luminance values of interpolation pixels, solid circles each 
represent the intermediate luminance value for each scanning 
line, and the dotted line connects the points of the 
intermediate luminance values. More specifically, the dotted 
line represents the edge of the picture. In this example, the 
intermediate value is a luminance value of "50". 

In comparison with the result in Fig. 11, the edge shape 
of the picture after interpolation is bent when the luminance 
values of the interpolation pixels are calculated only with 
the angle information of the picture as shown in Fig. 12 and 
a smooth edge cannot be provided by the interpolation. More 
specifically, the interpolation in Fig. 12 is carried out in 
the locally recognized angle directions, and therefore is not 
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necessarily smooth in terms of overall continuity. 

In contrast, when the luminance values of the 
interpolation pixels are calculated based on the angle 
information and arc shape information of the picture as shown 
5 in Fig. 11, a smooth edge approximated to the arc shape can 
be formed. 

Note that in this example, the interpolation reference 
positions are shifted by 0.5 pixel when an arc shape is 
recognized, but the invention is not limited to this, and the 

10 shift amount can be set as required. 

According to the embodiment, the binarizer 2 and the 
detection window video signal processor 5 correspond to a 
binary pattern generater, the reference pattern generater 6 
to a reference pattern generater and the angle detector 3 to 

15 a comparator. The arc shape detector 4 corresponds to a shape 
detector. The detection window video signal processor 5 
corresponds to a threshold value calculation device and a 
determination device, and the binarizer 2 corresponds to a 
binarizer . 



